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Introduction 



This report contains the field plan and implementation 
procedures which were utilized for the Observational (Focused 
Ethnographic) Component of the Child and Family Mental Health Project 
Evaluation funded under Modification 07 to Contract No. HHS-105-77- a 
1057* this report describes the plans and° activities which were 
employed to implement observational, participant-observational' 
interview, and unobtrusive research methods in the evaluation. These 
procedures wfire intended to augment the use of a >pre-post, control, 
experimental evaluation design which was employed in an effort to 
evaluate the impact of this preschool, Head Start Child and Family 
Mental Health Project. 

The Child and Family Mental Health (CFMH) Project constitutes 
an effort by Head Start to encourage the utilization of preventive 
efforts in mental health at the preschool level. 

Twenty-eight (28) projects were originally funded under the 
Head Start Child and Family Mental Health (CFMH) Project. These 
included seven (7) urban and seven (7) rural Head Start programs 
selected to implement demonstration projects and fourteen (7 urban, 7 
rural) sites designated to act as controls. The experimental programs 
were funded with the expectation that they would provide activities and 
services designed to achieve the preventive mental health goals of 
CFMH. Among these efforts are orientation to the project for Head 
Start staff and parents, training for staff and parents, professional 
consultation for staff, and parent counseling. , 

The introductory section of this document provides the reader 
with an overview of the Head Start program, its mental health goals, and 
the Child and Family Mental Health (CFMH) Demonstration Project, as well 
as an overview of the CFMH Evaluation effort. The relationship between 
evaluations quantitative and qualitative (observational or focused 
ethnographic) components is also discussed, as are the observational 
(focused ethnographic) approach and its policy and programmatic 
implications. 

The next section of this report is the design section. This 
section delineates the procedures that were employed in the observational 
(focused ethnographic) component. The acquisition and treatment of 
data is presented in the section that follows, with existing provisions 
for storage and retrieval, quality control, and analysis described. 
The final section of this document describes the field implementation 
of the ethnography, including the selection of personnel, the focused 
ethnographer training program, field entry, and a summary of observational 
(focused ethnographic) activities in the field. 



Overview 



Head Start Program Background 

The Head Start program was founded on the assumption that 
all children share certain needs and that children of low income 
families, in particular, can benefit from a comprehensive develop- 
mental program to meet those needs. The Head Start philosophy includes 
the idea that a child can benefit most from a comprehensive, inter- 
disciplinary program to foster development and remedy problems as 
expressed in a broad raftge of services. Equally a part of the Head 
Start philosophy is the recognition that the chiles enuire family, as 
well as the community, must be involved in such a program. The 
family, as the primary influence on the child's development, must 
be a direct program participant. L^cal communities are free to 
develop creative program designs within the* basic goals, objectives 
and standards of a comprehensive program* 

The overall goal of the Head Start program is to foster a 
greater degree of social competence in children of low income families. 
Social competence refers to the child's everyday effectiveness in 
dealing with both present environment and later responsibilities in 
school and life. Social competence takes into account the inter- 
relationship of cognitive and intellectual development, physical and 
mental health, nutrition, and other factors that enable a develop- 
mental approach toward helping children. The specific goals of 
tfScial competence include: 

(1) The improvement of the child's health and 
physical abilities, including appropriate 
steps to correct present physical and mental 
problems and to enhance every child's access 
to an adequate diet. The improvement of 
the family's attitude toward future health 
care and physical abilities. 

(2) The encouragement of self-confidence, 
spontaneity, curiosity, and self-discipline 
which will assist in the development of the 
child's social and emotional health. 

j (3) The enhancement of the child's mental 

processes and skills with particular 
*C S ; attention to conceptual and communications 

skills. 

(4) The establishment of patterns and expectations 
of success for the child, which will create a 
climate of confidence for present and future 
learning efforts and overall development. 



' (5) An increase in the ability of the child and 

the family to relate to each other and to 
others* 

(6) The enhancement of the'senge of dignity and 
self -worth within the ~.hild and his family. 

Through its Performance Standards and Guidelines (1975), 
Head Start has identified four areas of activity and standards of 
implementation for all grantees and delegate agencies. These four 
areas include education, health (including mental health and nutri- 
tion), social services and parent involvement. 

Education service* objecti es address the provision of 
positive learning environments and experiences, the integration of 
educational content into the daily program of activities, the involve- 
ment of parents in the program, . the development of parents in the 
areas of child growth and development, and the identification and 
reinforcement of home educational activities for parents and children. 

Health services Performance Standards call for medical and 
dental histories, screenings, examinations, treatment, record 
keeping, and health education. Mental health (described beloy) and 
nutrition objectives and services, moreover, are an integral part 
of the health performance standards. 

Social services objectives are concerned with providing 
an outreach and recruitment process to enroll eligible children, 
regardless of race, sex, creed, color, national origin or handi- 
capping condition; achieving parent participation in the center and 
home program; assisting the family to improve the condition and 
quality of family life; making parents aware of community services 
and resources and facilitating thexr use. 

Parent involvement objectives recognize the parent as the 
principle influence on the child's education and development and, 
thus, as essential contributors to the Head Start program. The 
parent involvement component of Head Start is intended to provide 
opportunities for parent participation, e.g., direct involvement 
in decision making in the program planning and operations; parti- 
cipation in classroom and other program activities as paid employees, 
volunteers or observers; activities fo* parents which they have 
helped to develop; and working with their own children in co- 
operation with Head Start staff. 

Mental Health Performance Standards and Guidance 

The mental health emphasis within Head Start is included 
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within the health area of activity. Health services objectives 
provide for a comprehensive program which includes a broad range 
of medical, dental, mental health and nutrition services to pre- 
school children, including handicapped children, to assist the child's 
physical, emotional, cognitive and social development toward the 
overall goal of social competence. Another objective is to promote 
preventive health services and early intervention. A third 
objective is to .provide the child's family with the necessary skills 
and insight,, and otherwise attempt to link the family fco an ongoing 
health care system to ensure that the child continues to receive 
comprehensive health care even after leaving the Head Start program. 

Specific mental health services provided under the health 
component include: 

(1) Services of a mental health professional who is 
experienced in working with children, at least on 
a consultation basis. The mental health professional 
(i.e., child psychiatrist, licensed psychologist, 
psychiatric nurse, or psychiatric social worker), 
shall: 

(a) Assist in planning mental health program 
activities; 

(b) Train Head Start staff; 

(c) Periodically observe children and consult with 
teachers and other staff; 

(d) Advise and assist in developmental screening 
and assessment; 

(e) Assist in providing special help for children 
with atypical behavior or development, including 
speech; 

(f) Advise in the utilization of other community 
resources and referrals; 

(g) Orient parents and work with them to achieve the 
objectives of the mental health program; and 

(h) Take appropriate step;, in conjunction with 
health and education services to refer children 
for diagnostic examination to confirm that 
their emotional or behavior problems do not 
have a physical basis. 
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(2) Other services, activities, and provisions under the 
Head Start mental health plan are: 

(a) Attention to pertinent medical and family 
history of each child so that mental health, 
services can be made readily available 
when needed; 

(b) Use of existing community mental health 
resources; * 

(c) Coprdination with the education services 
component to provide a program keyed to 
individual developmental levels; 

(d) . Confidentiality of, records; 

(e) Regular group meetings of parents and 
program staff; 

(f) Parental consent for special mental health 
services; 

s 

(g) Opportunity for parents to obtain individual 
assistance; arid « 

(h) Active involvement of parents in planning 
and implementing the individual mental health 
needs of their children. ' 

The concept and goal of prevention is stressed in the 
Head Start^neutal health goals, as in all other health areas. Over-, 
all, preveroJve mental health is intended to minimize a child f s 
later need for mental health services, to provide mental health 
resources to Head Start parents and to provide them with strategies 
for coping with life crises and the day-to-day demands of the pre- 
school placement and other settings in which the child and parents 
might engage. These services are intended to minimize each 
family's later deterioration and dependence on remedial mental health 
and social services. 

The Head Start Child and Family Mental Health Project 
(CFMH) was designed and implemented toward this overall goal of 
preventive mental health for children and their families. The 
fallowing section describes the assumptions, goals, and imple- 
mentation activities of the CFMH project. 
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The Child and Family Mental Health Project 



* , The Child and Family Mental Health Project is a multi-year, 
demonstration project funded by the Administration for Children, \ Youth and 
Families, under the auspices of the Head Start Pfogram. The project is 
both unique and innovative in its attempt to encourage the systematic 
application of preventive /mental health principles in selected Head Start 
programs and its intent is to actualize particular goals that have been an 
inherent part of ^ Head Start since its inception. While cognitive, language, 
physical and health Concerns have been central to Head Start, children's 
social and emotional development has been as much a part of the program 
purpose. The ultimate concern of the CFMH effort is reflected in the Head 
Start Performance Standards (1975) specifications to assist children in 
the areas of emotional, cognitive, and- social development for enhancing 
social competence, while providing staff and parents with knowledge of 
child growth and development and an appreciation of individual variation, 
and the importance of a su&ortive environment. 

0 Particular note should ^ made of the conceptual orientations 

reflected in the CFMH Project. For example, healthy social-emotional 
development is defined positively as "mental wellness." Furthermore, 
mental health intervention is attempted at a primary stage or level, 
before social-emotional problems develop, rather than at secondary and 
tertiary levels when these problems begin to interfere with or adversely 
influence a child's ability to cope with his environment (Caplan, 1964). 
In practice these orientations translate into programmatic strategies 
that facilitate children's mental and social-emotional wellness, while 
preventing the onset of conditions that hinder their ability to success- 
fully engage their material and social environment. 

The primary means of attaining the desired goals of this 
project is through the implementation of experimental preventive mental 
health programs that are consistent with the ecological philosophy and 
approach of Head Start. As a demonstration effort, the goals of the 
project are" to: 

(1) Promote and demonstrate the efficacy of 
ecological approaches to the delivery of 
primary preventive mental health services 
for preschqjxL children. 

(2) Develop ecological^mo^els for the delivery 
of primary preventive mental health services 
that can be implemented on "a wide scale in 
Head Start and other child development 
programs. 

* 

These goals stem from a realization that different levels of 
mental health resources available across communities require more than 
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one delivery strategy. Some communities, for -example, may have a wide 
range of locally available mental health services. Others, by 'contrast; 
may be locaced out of easy reach of relevant services. Local CFMH efforts 
thus, must take into account the quantity, type and accessibility of 
outside mental health services in designing optimal programs for their 
Head' Start communities. Thus, the two following alternative models for • 
implementing a variety of primary prevention activities are being used 
'in specific programs: 

(1) Child and Family Mental Health, Resource Model .' 
The Head Start program Collaborates with a 
community mental health facility to design a 
program suitable to the particular needs of " 
program participants. Under the community 
linkage approach, the Head Start program 
purchases training, consultation and counseling 
services from the facility and operates the 
mental health program in partnership with that 
support group of mental health professionals 
(MHF'S). 

(2) Child^and Family Mental Health Worker Model . 
This model is especially appropriate in 
communities which lack available local mental 
health facilities. In this approach, a Mental 
Health Worker (MHW) is based in the Head Start 
program to provide mental health services. Workers 
are trained for specific competencies- necessary to 
provide training, consultation, and counseling 

services and work under the supervision of a 

mental health professional (MHP) who may be 

located outside the community. \ 

While these two models serve as frameworks for pursuing the \ 
aforementioned goals, specific activities have been suggested for imple-\ 
mentation by the fourteen experimental programs. These activities and 
their specific objectives are as follows: j 

(1) -Drientation for (a) Staff and\(i) Parents— 

to provide information and discuss the goals, " 
objectives, and activities of the project. 

(2) Training for Staff — to promote understanding 
of normal child growth and development, 
techniques for observation required to identify 
children 1 s needs and develop an individualized 
program, techniques of child management, and 
identification of adult attitudes and behaviors 
that contribute to a healthy climate. Strengthening 
and expanding the capacity of staff to handle 
crises and developmental stress points* 
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(3) Training for Parents — to provide an under- 
standing of child growth and development, 

*'a sensitivity to developmental problems and 
knowledge of effective childrearing practices, 
child management, and identification of adult 
attitudes and behaviors that contribute to a 
healthy climate for growth. 

(4) Consultation with Head Start Staff— (a) Small 

* Group Consultation — to strengthen staff skills to 

handle situational stresses and developmental 
crises. This process provides all staff with 
an opportunity to learn new concepts and coping 
' techniques and provides ongoing training in 

areas of child development and child management 
v . , techniques; (b) Support Consultation — to 

familiarize the consultant with the characteristics 
of each class and to provide an opportunity for 
conpultee-centered consultation. 

(5) Counseling with Parents— to provide crisis 
intervention as needed tc- strengthen parents 1 
skills in dealing effectively; with challenges and 
conflicts which are inherent in the transition from 

* one psycho-social developmental stage of life to 

the next, and with structural crises (e.g* r illness, 
death, separation, etc.). Counseling will maximize 
' the successful management 0 and mastery of the crisis 
or stress points in the lives of the parents and 
their children. 



The CFMH Evaluation 



The evaluation of the CFMH Project was initiated in September, 
1978, approximately one year after Head Start Centers were funded to 
Implement preventive intervention strategies which they designed for 
theim programs. The quasi-experimental design included the comparison 
of two treatment groups (Mental Health Worker [MHW] Model and Community 
Resource [CR] Model) with matched comparison groups, using a new set of 
cohorts each year within a pre-post paradigm. The original evaluation 
design is best conceptualised as involving multiple phases (3 years), 
using multiple levels of evaluation (process, impact, and indepth), and 
using a pre-post paradigm with data collection periods in the Fall and 
Spring of the contract year. The design i* presented in Figure 1. 



The. Office of Management and Budget 9 s long delay in approving 
the proposed process measures lad to reconsideration of the overall 
evaluation design. In general, the reconsideration led to changes that 
contribute immeasurably to the quality and the inter pretability of the data. 
These changes effectively expand the evaluation design to use different 
evaluation designs for different aspects of the study. Specifically, 
the changes Indicate the: 
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(a) use of the summative approach to acquire 
descriptive and evaluative d^ta about the 
program from Head Start teachers\md parent?; 

(b) use of the repeated measures design in the 
acquisition o£^ impact data; 

(c) use of the goal attainment approach with 
program administration; 

(d) use of a more formative approach to data 
* collection at all sites in which the 

ethnographic approach is not used. 
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Figure 1. CFMH Evaluation Design. 



Relationship Bet veen Quantitative and Qualitative Components 

The adoption of the ethnographic approach for the evaluation 
of CFMH Programs was undertaken for several reasons. Generally, it 
increases the congruency between the purposes of the evaluation and the 
evaluation methods, while the ecological principles upon "hick the CFMH 
Project is based are cpnsistent with the ecological principles upon which 
ethnography is based. Ethnography's naturalistic approach, in addition, 
enhances the study of real life events in the programs being evaluated* 

While a quantitative evaluation design yields statistical patterns 
and outcomes among the variables in question, such a design typically falls 
short in clarifying how or why these have come about. This is particularly 
true for studies taking place in natural settings, because numerous inter- 
vening variables cannot be controlled as in a laboratory experiment. 



\ 9 

12 



The ethnographic component is specifically designed to reveal 
issues of process and context as they impact on CFMH implementation. 
With the addition of ethnography, cross-site patterns and generalizations 
can be more clearly illustrated thru specific case examples. At the same 
time, the variability and uniqueness of CFMH programs can be explained 
in terms of a local complex of interrelated variables which, again, is 
best done through the presentation of in-depth case material. 

The Ethnographic Approach 

The methodological approach which best complements the currently- 
used methods and has the greatest utility for meeting the global and 
specific objectives of the evaluation is the ethnographic approach. The 
ethnographic approach is one which can acqurc qualitative and quantitative 
information via relatively long-term interaction with the subjects under 
study in their natural environment, thereby improving both the quality and 
interpretability of the data. These and other advantages will be discussed 
in the context of the following, which"*explicates how the ethnographic 
- ^ approach may be used to address potential problems in the quantitative 




Limited observations . The disadvantages inherent in a maximum 
of 4 weeks' data collection per year can be effectively countered by the 
systematic use of participant-observers who interact with the Head Start 
personnel, children and families over the course of the school year. The 
number of observations using this approach increases many time^ as well as 
significantly lessens the impact of programs behaving differently during 
discrete data collection periods. Thus, the approach yields an immeasurably 
richer description of the preventive mental health interventions, thereby 
increasing the replicability of those interventions found to be effective. 

Validity of observations and confounding of roles > The problem 
pf teachers and other Head Start staff rating children, especially early 
in the school year, can be addressed by using independent observers/ 
raters in the same setting. While teachers may continue to serve the dual 
roles of program implementors and evaluators, the independent observations 
by the participant-observers may allow rn assessment of the effect of 
playing the dual roles. At least one set of data will be obtained by 
personnel (participant-observers) whose role is not confounded. The 
addition of the independent, participant-observers will also lessen the 
reliance on evaluations of teachers made early in the school year when they 
are the least familiar with the children. 

Limited exposure to intervention . There is little guarantee that 
the effects of the intervention activities will be reflected by the 
dependent measures within the same year of the exposure. The presence of 
the participant-observers will allow for observation of changes too fine 
to be detected by end-of-the-year data collection procedures. Since it 
is not possible to extend the period of intervention or increase the time 
between Fall and Spring measures, the intensity of the measures can be 
increased with the intent of documenting the more subtle changes that may 
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occur within the school year. 

While the technical improvements in the design are important, 
the results of these improvements argue most eloquently for the use of 
ethnographic methods. The increased improvement in the quality and 
interpretability of the data resulting from these changes will greatly 
enhance the meaningfulness and utility of the evaluative effort. A 
hypothetical example illustrates the point ♦ The process component of the 
evaluation is designed to obtain an operationalized description of the 
preventive activities in sach program. It documents the preventive 
activities specifying their frequency, the participants, purpose, etc. 
The procedure cannot systematically Acquire information on the effect 
and unotional tone of the meeting. It is therefore possible to attribute 
a positive meaning to data suggesting that a program has significantly more 
parent meetings than other programs. In reality, the parents 1 meetings 
may reflect parents* concerns about problems they perceive in the operation 
of the program. The presence of a participant-observer will allow a 
description of the meeting in a manner that reflects the tone, utility, 
and outcome of the meeting. The amount of information obtained from a 
participant-observer's report of a meeting with parents would be much more 
than could be asked of Head Start staff without violating the principle of 
minimal obtrusiveness. 

Goal of the Ethnographic Component 

The overall goal of the Ethnographic Component is to adopt and 
implement a set of procedures to complement the quantitative aspects of 
) the current evaluation design in a manner that strengthens the design 
explicated above. The specific objectives explicated below address 
particular aspects of the current design and are further elaborated in 
Part II of this document., 



(1) To increase the number and scope of observation 
in two selected sites; 

(2) To develop and implement a more indepth set of 
observations designed to (a) facilitate the 
indepth description of the intervention 
strangles used itfsCFMH experimental programs; 
(b)/to document and evaluate *the short-term effects 
of primary preventive interventions, and (c) to 
describe the affective component of the activities 
documented by quantitative procedures; 

(3) To complement the quantitative data through the 
acquisition of qualitative data on a continuous 
basis; 

(4) To provide an independent evaluation of children 
and families as well as the changes in some as a 
function of - the primary preventive interventions. 
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Policy and Program Implications of the EthnoRraphic Component 

The integration of the ethnographic approach into the CFMH 
Evaluation enhances the latter' s potential for affecting policy decisions 
for Head Start programs, as well as other early childhood education programs. 

* Increasing budget constraints at all levels of government, more sophisticated 
demands for service on the part of consumers, providers, and sponsors, and 

a solidifying social commitment to better understand and care for pre- 

* school children all point to the need for evaluative efforts that wili most 
usefully inform the decision process. In this sense, the jlend of the 
ethnographic and standard approaches in the CFMH Evaluation is both a major 
step in the required direction, while serving as a model for other evaluation 
efforts with implications for policy formulation. 

Better informed policy questions and decisions will result from 
the addition of the Ethnographic Component to the CFMH Evaluation. While 
quantitatively reported data can provide gross and "average 11 profiles of the 
uses of public resources for meeting policy goals, policy makers, as well 
as their ctojistituents, are increasingly concerned over the actual, specific 
uses of thJse resources. Ethnography, through the in-depth reporting of 
specific case examples (e.g., of two CFMH programs; implementation of 
alternative primary mental health prevention models; day-to-day imple- 
mentation activities and constraints; specific involvements of and effects 
upon actual program administrators, mental health personnel, teachers, 
parents, children, etc.) serves to facilitate this kind of accounting^ 
Specific information such as that provided by ethnographic research is of 
direct value to the making and re-evaluation of policy. Thes^ processes 
are enhanced through the feedback of actual priorities, constraints, and 
experiences as reported from a sampling of real, rather than hypothesized or 
assumed field contexts. 

Head Start and other early childhood education programs will 
benefit directly from a CFMH Evaluation that incltdes the descriptive 
strength of ethnography. An expected outcome of the evaluation project is 
a full description of conceptual and implementation issues surrounding an 
unprecedented attempt to develop primary preventive strategies in pre- 
school programs. The lessons learned from such an attempt will be systemati- 
cally presented in a manual designed to guide other pre-school programs in 
their attempt to develop primary preventive mental health programs. The 
manuals will reflect successful means of overcoming implementation problems 
identified by the key personnel in the CFMH programs. Among issues likely 
to be addressed are ways of handling parent and/or community sensitivity 
to mental health issues, selecting mental health personnel with a primary 
prevention orientation, developing a philosophy of preventive mental 
health among staff, and maximizing the cooperation of parents as recipients 
of primary preventiop intervention. The vehicle for generally applying 
the findings of the CFMH demonstration will be the sharing of these manuals; 
their utility will be maximized by their fullness and specificity resulting 
from a combination of quantitative and qualitative data bases. The manuals 
will be submitted to the Administration for Children, Youth and Families 
as a camera-ready document. 
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Design of the Ethnographic Component 



Goals , 

This element of the CFMH Project evaluation has *ive primary 
observational^gbalsfto be conducted over an 8-month data collection phase 
at two pre-selected sites. These goals, which relate to both process and 
outcome variables <Jf the CFMH Project, are listed below: 

(U Through intensive, unstructured but focused 

interviewing with teachers and other classroom 
staff, program administrators, mental health 
personnel, and others, obtain systematic 
information regarding their: 

o attitudes, beliefs, and knowledge about 
mental health; 

o attitudes, beliefs and knowledge about 
primary prevention; 

o Specific classroom techniques for achieving 
mental wellness and primary prevention, and 
observable behaviors for. recognizing positive 
-mental health and primary prevention when 

_jthtey occur. 

(2) Develop two "inventories": 

o "An Inventory of Mental Wellness and Social 
Adjustment" which will be a compendium of 
culturally-sensitive behaviors evidencing, 
in children, qualities or states of mental 
wellness and social adjustment. (or their absence). 

o "An Inventory of the Implementation of Mental 
Wellness and Social Adjustment in the Classroom" 
which will itemize those adult-based behaviors 
thought by those at local sites to promote, 
teach, or guide the mental wellness and social 
adjustment of their school children. 

These inventories will be based on the interview 
material collected in (1) above, on materials 
available in the mental health literature, and 
through on-site observations in the classroom. One 
important use of the inventories will be in the con- 
struction of systematic observatioaal protocols (see 
(3) beloy) for repeated use with classroom program 
participants. 




13 



ERIC 



16 



(3) Conduct repeated observations of subsamples 
of CFMH program children and teachers during 
the school year. The observations will focus 
upon aspects of mental wellness and social 
adjustment (see Appendices A and B). 

(4) Collect information using traditional 
participant-observer techniques developed 
within anthropology and allied disciplines on 
non-classroom CFMH implementation activities, 
e.g., orientation, training, counseling, 
consulting sessions, and other activities 
provided for CFMH staff and parents. 

(5) Within a highly-focused observation "frame," use 
paricipan (-observers to collect information on 
these factors, and the contexts within which 
they potentially affect the CFMH Project imple- 
mentation, impact, effectiveness, generalizability, 
and/or evaluation. 



Rationale 

The focused ethnographic evaluation plan summarized above is 
based on the relationship of elements in the CFMH Project diagrammed 
below: 



Historical, 
cultural, 
Intellectual 
context within 
which the CFMH 
program is 
situated. 



Mental Health Model 
"A" or "B" 



Outcome 1 Outcome 2 

Staff and Head Start 
Parents Children 



Figure 2. Relationship of CFMH Elements. 

In this model of intervention, mental health professionals or 
trained paraprofessiohals impact on teachers, aides, other staff, and 
parents through a variety of programs designed to acquaint them with the 
goals and techniques of primary prevention. The change in knowledge, 
attitude, or behavior of staff and parents over time is thus one way of 
'measuring pro-am effectiveness. Parents and staff, in the model depicted 
in Figure 2 directly impact upon the children rather than mental health 
personnel themselves. Changes in children's behavior related to culturally 
sensitized measures of mental wellness axe -i second outcome variable, and 
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provide some measure of program utility. Since program effectiveness, 
or lack thereof, may stem from factors other than the program itself, it 
is essential to monitor the socio-cultural, local political, and class- 
room mileus within which the CFMH programs operate. ^| 

A shortcoming of this ethnographic evaluation plan, however, is 
related to precisely this recognition that causes as well as indicators 
of program effectiveness do occur in extra-classroom milieus. Ideally, a 
focus on parent behavior and home adjustment aspects of the CFMH effort 
would have been included as part of the ethnographic component. However, 
budget limitations (i.e., one ethnographer per program), the priority to 
evaluate on-site CFMH implementation, as well as access and etfiical issues 
of observing in the informal home setting, are all factors that work 
against a systematic parent/home focus to the ethnography. The ethnographers, 
however, will take advantage of any opportunity sample that may crop ut> in 
this area. One ethnographer (Indiana, PA) will accompany, a caseworker on 
home visits; the other researcher (Georgetown, TX) will follow-up on 
invitations by parents »-o visit their homes. 



Data Storage and Retrieval System 

In order to expedite the coordination of qualitative data collected 
by the fieldworkers working semi- independently , a multi-faceted data storage 
and retrieval system has been established. This system is keyed to the ■ 
five observational goals described earlier and is intended to be a major 
tool in the organization, reduction, and eventual analysis of the observa- 
tional data. 

Data storage and retrieval systems for qualitative data sets are 
comprised of two parts: format and index. Both may be used for organi- 
zational purposes. Format refers to the physical form notes will take and 
file structure itself. An index, on the other hand, much like the index 
of a text, allows the compiler to pair written materials with certain 
predetermined key words, or category headings. By denoting on what page 
of the field note set a r certain heading may be found, the user may retrieve 
any and all information clarified under that heading. 

Field notes for the CFMH program evaluation will be typed by the 
Focused Ethnographers (FE's) on 8*5 x 11 pap$r, punched, and entered into three 
ring, loose-leaf binders, and stored. Duplicates will be sent to the Urban 
Institute weekly and filed there as well. A page code (see Appendix C) has 
been developed by which each separate page of field notes can be uniquely 
identified by fieldworker, by file structure, and by page within the file 
structure. 

There are nine (9) files in the CFMH program evaluation (see 
Appendix D) . The first file (File 1) >is intended to organize all interview 
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data relevant to beliefs about, attitudes toward, and knowledge of mental 
wellness and primary prevention, as well as 3pecif ic child behaviors by 
which mental wellness and primary prevention can be recognized. File 2 
will contain all pertinent observational material related to the class- 
room implementation of mental health and social adjustment. File 3 
organizes all remaining interview data not contained in File I. Separate 
types of information will be accessed through the index system (see below). 
The sub-files of File 4 are designed to integrate all observations made 
by the FE's on training, orientation, counseling, consultation, and other 
specific site events by which staff and parents are given information 
regarding primary prevention and mental wellness. 

File 5 contains all general field notes pertinent to process 
aspects of the CFMH Project. As with File 3, information will be retrieved 
using the index. File 6 will be reserved for the child observations and 
will include only observation 1 narrative reports. 

File 7 is the Daily Log. This permits both the FE's and the 
Supervisor of Ethnographers (SE) to monitor on a daily basis the amount of 
time spent on a site and in pursuit of the various observational goals, a 
running record of all contacts and observational periods, capsule accounts 
of daily activities with extensive cross-referencing to the remaining files 
where extended notes are maintained and available. 

Files 8 and 9 are intended for the use of both the FE's and SE 
to combine, in two places, all emerging themes, ideas, identified patterns, 
and research avenues necessary for follow-up. These files will be used 
sporadically throughout the entire data collection phase. 

Finally, an index with keyed numerical codes has been developed. 
This is a limited index reflecting the somewhat limited scope of the ethno- 
graphic observations to be undertaken. As can be seen from its organization 
(see Appendix E), it is limited only to items of information relevant to the 
impact, effectiveness, and implementation of the CFMH Project. It is 
organized hierarchically to allow the unobtrusive addition of further cate-. 
gories of information deemed to be relevant once f ieldwork has begun. As the 
index and its use will be monitored by the SE, it permits direct comparison 
of data across sites. In actual operation, numerical codes will be entered 
in the margins of field notes and the field note page itemized by numerical 
code in a master index (see Appendix C). 

Quality Control and Reliability 

The effectiveness of the participant-observer approach rests 
heavily upon the ability of the researchers to make themselves a sensitive 
research tool by suspending their personal perspectives and becoming 
acquainted with the perspectives of those they study. If the strength of 
the approach lies in tie abilities of the participants to make this change, 
the weakness lies in their ability to make the change too well. The 
possibility of over- identifying with those being studied must be recognized. 
The field plan addresses this potential problem in three ways: 
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(1) v periodic trips back to the corporate office for 

meetings with the SE and other CFMH evaluation 
staff; 

(2) periodic trips by the SE to the field sites; and 

(3> constant itiLeraction between the ethnographers 
and their supervisor around field notes, 
perspectives, developing hypotheses, etc. 

Other techniques for checking data reliability are being imple- 
mented. . Data received at the Urban Institute for Human Services is subject 
to random blind-coding by the SE (Appendix F). Confirmation and refinement 
of coding categories, as well as evaluation of the ethnographers 1 accuracy 
is insured in this manner. Moreover, the supervisor w 11 conduct on-site 
parallel observations of children's behavior for ass •» the reliability 
"of the ethnographers 1 observations. * 

The significant disadvantages of the ethnographic methodology can 
be controlled through the use of a semi-structured approach with intense 
training, monitoring of data, and frequent interactions with the CFMH 
evaluation staff. With these procedures to address anticipated problem 
areas, the required tasks under the scope of work can be completely met, 
while insuring minimum levels of data quality and reliability. 

D ata Analysis 

The nature of ethnographic research allows data analysis to begin 
before the data are received from the field. Data collection is done on a 
continuous basis so that the ethnographic research tasks of description, 
hypothesis formulation and refinement can proceed on a cumulative, empirical 
basis. Particularly in ethnographic research, these tasks are always tenta- 
tively complete^t&th increasing f inility deriving as a function of the 
length of the ethnographic work. 

Data analysis will be a central priority of the ethnographic 
component commencing in spring 1981. Foreseeable tasks and products of this 
thrust include finer organization of the data, summaries o r interim findings, 
interpretive discussions of specific CFMH concepts-in-use and implementation 
activities, summaries of common or unique pattens of organization or 
behavior in the two ethnographic sites, and increased collaboration with the- 
CFMH evaluation staff responsible for statistical and conceptual analyses 
of the quantitative data". In ethnographic research, the ethnographer who 
has collected the data remains its primary analyst and interpreter. Thus, 
data analysis will be the primary task of the ethnographic component upon 
the ethnographers 1 return from the field in June* Eventually, the data from 
the ethnographic component will be analyzed both separately and with data 
from the other components of the evaluation. 
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Field Implementation of the Ethnography 

Personnel Selection ' 

Prior to the beginning of the current evaluation year, the Urban 
Institute for Human Services recruited, hired and trained a research 
scientist and two research associates to serve as the supervisor of 
ethnographers and focused field ethnographers, respectively. This staff, 
with input from an expert consultant in ethnography, was responsible for 
the development of procedures, protocols, and data organizing systems to 
implement in-depth, focused observations i the selected field sites. 

The Urban Institute for Human Services has developed a procedure 
for the recruitment of senior staff that takes advantage of the rich 
resources in the Bay Area, other sections of California, as well as selected 
resource <^pters across the country. For Bay Area recruitment, the Institute 
has estabflshed a mailing list to which job announcements and job descriptions 
are routinely sent. The list includes: 

(1) The placement officers of the major colleges 
and universities in the state; 

(2) Newsletters of national, state, and local 
professional organizations; 

(3) Major research organizations ift the area; 

(4) Members of Advisory Committees of all Urban 
Institute projects; and 

(5) Associates of The Urban Institute. 

Recruitment of support staff involved advertising in the classified advertise- 
ments of the Bay Area newspapers. 

Supervisor of Ethnographers . Responsibilities- and duties of the 
SE include: 

(1) Train ethnographers in observing, recording, 
note-taking, narrative writing, interviewing, 
role management and ethics, formatting and 
indexing field notes, data reduction and 
analysis; 

(2) Monitor the data collection activities of c 
ethnographers through review of their field 

notes and reports at the corporate offices 
and at the Head Start field stations; 

* 

(3) Supervise the development of a coding and 
filing system, planning for the storage and 
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retrieval of information, and iniuftng- — 
quality control; - 

(A) Prepare/select focusing agendas to be used 
by^hnographers in data collection; 

(5) Supervise data analysis of data collected by 
ethnographers; 

(6) Work cooperatively with research scientist 
responsible for the collection and analysis 
of data derived from strictly quantitative 
methods; and 

(7) Prepare periodic and final reports of the 
ethnographic compon43t of the evaluation. 

The SE has had considerable experience in participant-observation, develop- 
ment of coding plans, storing and retrieving data, and supervising 
participant-observers in educational settings.* The SE reports directly to 
the CFMH Project Director and works closely with the expert consultant in 
ethnography. 

Focused Ethnographers > The duties and responsibilities of the 
FE's include: 

(1) Review all documents associated with the CFMH 
Project and its evaluation to become familiar 
with the entire project; >r 

r 

(2) Visit at least one Head Start Center in' the 
Bay Area; 

(3) Participate in the development of focusing 
agenda quality control plans, coding and - 
filing systems, and data analysis fffSns 
for use during Phase III; 

(4) Participate in training programs designed to 
train and standardize ethnographers 9 
observation, coding, data reduction, etc. 
procedures; 

(5) Set up field stations and on-site observations 
as an aspect of training; and 

(6) Make all arrangements to set up field stations 
in selected Head Start programs for Phase III 
data collection. 

The ethnographers have masters degrees in an appropriate behavioral or 



19 



22 



social science, as well as some experience in participant-observation, 
interviewing, and/or other forms of data collection. The ethnographers 
were screened for writing skills, sensitivity to cultural variations and 
motivation. Ethnographers were expected to be self-starters, perceptive, 
~^rt*4v^deinonstrated ability to work in semi-structured situations. 

Secretary . The dutieiTof the^aecretary were designed to meet 
the support needs of the ethnographic teamTTiT addition to traditional 
secretarial duties of scheduling, maintaining calendars Pscreenin^calls , 
composing letters, filing, etc., the secretary has a substantial load^of- 
typing notes and manuscripts, and maintaining a filing system for qualitative 
data. 

Expert Consultant . Harold Levine, Ph.D., from the Department of 
Education, UCLA, serves as the expert consultant to the CFMH Ethnographic 
Component. His .experience in ethnographic methodology, training of 
qualitative researchers, and in the blending of quantitative and qualitative 
data makes him an invaluable resource to the ethnographic effort. 



Training of Focused Ethnographers 

The training of the two FE's was undertaken over an intensive 10- 
day period totalling approximately 80 hours. The training, mbdified from aff) 
experientially-based course taught at UCLA over the past seven years by the 
two trainers (Levine, Gallimore, Weisner, & Turner, 1980), stressed six v 
essential skill domains: role management, ethics, observing, recording, data 
storage, and data reduction analysis. While general skills and issues were 
addressed, every effort was made to key the training to the foreseeable 
problems and site, demands that the FE's would likely encounter. 

Appendix G summarizes the training progr^ itemizing major domains 
of instruction (e.g., role management, recording), skill-building goals, and 
actual training session format and content. As can be seen, the training 
mixed general observational goals with specific background material on the 
Urban Institute, evaluation research, mental health and primary prevention, 
and the Child and Family M&ita} Health Evaluation. Dts. William Hayes and 
Thomas Hilliard and Jose Macias were responsible for this latter set of 
materials. • 

In terms mi the observational training, the first four days of 
instruction introduced the major issues in participant-observation research 
so that the FE's could be comfortable collecting data related to a mini- 
project of their own design at a local Head Start center. Specifically, 
the first four days of the observational training were meant to achieve the 
following goals: 

o Introduce the overall training plans for the 

10-day period and the style of experientially- m 
based training that would be used; 

^.o Establish the principles of role management 
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in participant-observation field research, 
and situate the exercises and discussions 
in terms of the ethnographers 1 own field 
evaluation project; 

— o Discuss ethical , legal, and policy issues 
related to field evaluation research; 

o Introduce the flexible use of field note 
styles ; 

o Develop the use of question-generating as 
a field and note-focusing technique; 

^ o Guide the staff in designing and actually 
""""" ^-implementing a mini-project at a local 
Head^Ttart^te^and w 

o Review common terms ain^concepts in the 
field of qualitative research. 

1, Introduction ' 

The training program began with a combination of trainer 
exhortations and immediate* f ieldwork experience. Initial introductions 
'were followed by a review of some of the principles underlying effecting 
f ieldwork at any site,: self-reliance of the researcher; experiencing and 
participating in the tasks and skills, rather than merely discussing them; 
matching conceptual issues to actual tasks relevant to the particular 
contract and field setting the trainees would be' in; and the importance of 
using existing skills in new ways. 

Very early in the training, an exercise was used to concretise 
the idea of linking the training with actual f ieldwork and evaluation goals. 
Each staff member was asked to imagine writing a page of field notes on a 
chosen topic, and to read a paragraph aloud. Everyone discovered that even 
in the imagination this is a hard task to do. . What will final prose look 
and sound like? What will be its focus? Then staff was asked to imagine 
that final reports and executive summaries were being written, and to read 
Imaginary paragraphs aloud. The trainees' found this to be quite difficult 
and discovered that the examples of notes had little to do with the 
executive summary in form, content, or style. The goal of focusing on the 
production of structured notes as data, and keeping the final reports and 
design in mind was emphasized. 

2. Role Management 

The staff undertook an initial field exercise by observing for 
one-half hour at the adjacent Montessori School. Field notes were produced 
on what was done and discovered. Through this experience $ a series of 
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issues in role management were introduced. Subsequent discussion and the 
use of selected examples and research literature allowed the development 
of the following points: 

o Making initial contacts; having a pla' for this; / 
sequencing; 

o Presentation of self; definition of roles; , 
body language; 

o Initial disclosure and information plan; * 
o Keeping a diary; ' 

o Consciously having a strategy for role 
negotiations; 

o Monitoring reactivity and obtrusiveness; having 
a plan for regulating this problem; 

o Knowing the legal and other permissions needed 
to do field work; 

o Understanding others' cognitive maps, their 

concerns, fears in terms of the researcher f s role; 
being* clear about Implicit assumptions of others; 

o Planning ahead from the beginning for a role change 
as the year proceeds, and for termination of the 
study. 

"1 minute talks" and "5 minute \alks" that are useful when 
initially meeting other people at the sites and in the community, for explai 
ing one f s purposes for being on site, were practiced. The importance of 
confidence and practice in the$e brief initial self-presentations and 
presentations of the project were emphasized. ^ 
* ' ?- 

3. . Ethics 

Over 10 hypothetical cased were presented* to the staff concerning 
real fieldwork problems including showing data in the field, observing 
illegal events, how to "deal with political in-fighting, miking judgments 
about competence, and others. A set of situational procedures were 
discussed for making field decisions about such matters. Referral to the 
Urban Institute was stressed, as well as keeping legal and moral responsi- 
bilities in mind. 

- A. Field Note Methods 

A field exercise was developed for staff to practice taking notes 
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in a variety of different styles. Three primary styles initially used 
were holistic note styles, radical empiricist styles, and focused observer 
styles. Staff did field notes using each style, then read and discussed 
them as a group. 

Different stages of fielti notes were discussed, from the raw note 
sitate on the spot, to rough notes, to finished final notes (» data). The 
importance of allowing approximately two or more hours of note work for 
every hour of fieldwork was emphasized, as was the division of the note 
page into sections. for initial narrative and additional materials generated 
later. ^ * ' 

5j Question-generation , 

Staff did a field exercise to generate questions about the 
Montfessori school site, and then discussed how to use question-generation in 
ttftcontext of on-go^ng field researchi Its importance as a priming and 
"psyching-up" mechanism was emphasized, as well as its role in keeping the 
field work explicitly focused on goals relevant to the evaluation contract 
and to the needs of *the interim and final reports to agencies. The fine 
distinctions between answerable and unanswerable questions were discussed, 
and the levels of questioning in' the field appropriate to iieldwork roles 
and relationships were stressed. 

6. Design of a Mini-Broject ^ 

Staff generated a researchable question and prepared an initial 
fieldwork design to explore the topic at a, Hea^i Start bite xn Oakland, 
California. The steps in preparing such a design were reviewed, and one 
morning was spent in the field doing a preparatory field trial on the 
feasibility of the questions jand the strategy developed to address it. 

7. Terms and Concepts in the Field 

Lecture time was reserved to review some of the key terms and 
definitions -in the field of qualitative research methods; to briefly cover 
the strategic question of when to interview versus observe directly; and ■ 
a brief overview of sode of the methods of training currently, available 
in this field. Some illustrations from other ethnographic evaluations 
were discussed, and bibliographic materials on participant-observation 
were availably to the staff. * " 

The second 3-day observational training period was primarily 
devoted to , the refinement of data collection skills. Specifically, 
training focused # on the following skills: (1) formatting and indexing 
field notes and actual development of the data storage and retrieval 
system to be used by the Urban Institute; (2) focused interviewing; (3) 
use of mnemonic and shorthand skills in transferring .complex, multi- 
level, multi-dimensional, rapidly occuririg behaviors into tn ad-written 
narrative accounts; (4) continued fieldwork ay the l(jcal Head otart site 
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on mini-projects define^ earlier in the training and on additional 
exercises related to classroom material, 

8. Formatting and Indexing 

The trainees were introduced to the major organizational and 
conceptual principle's involved in formatting and indexing field data. They 
were told how file structures can be established to complement observational 
questions, the places of files in eventual data reduction and &nalysis, and 
the., importance of balancing specificity in data collation with flexibility 
as new understandings arise during the course of fieldwork. They were 
taught* abou,t'the< hierarchical organization^ indexes, How point of view of 
the observer- (whether as "insj^er" qr "outsider") affects the choice of 
index' terms and' how %n*ex ntmerical codes:. cat} be paired with written 
narrative data for lat&mr retrieval. m \- % • . 

With this background as weH as their limited field step' 
experience, the FE's and trainers developed the data storage and retrieval* 
system which the FE's will actually ufce-Ajt their sites.- The FE's, there- 
fore, not only helped produce this system, but were party to the discussion, 
on the rationale for and intricacies of- its use. Additionally, review and 
monitoring procedures were established with the SE. The final product was 
designed to be as straightforward as possible. The nine files °and the ' , 
index numerical code may be found in Appendices D and E. The FE'*s practiced 
with the completed system on their own field notes generated over the part-- 
time days at the local Head Start site. In the process, additional problems 
were resolved. , . 

9. Interviewing 

The interviewing exercise consisted of four sections, each meant 
to approximate in progressive stages an actual field site focused interview. 
Initially, the FE's were intr" J uced to focused interviewing through lecture 
material intended* to show the general features of this interview type, as 
well as its strengths and limitations. It was compared with the more 
informal "jawboning" which is inevitably done in field research and the 
highly structured survey or questionnaire format. 

Daring the second phase of training, the FE's were shown video- 
tapes of two actual interviews. The FE's were instructed to watch these and 
take notes on characteristics of the informant, interactional strategies 
used by the interviewer, and question-asking skills and types. Their notes 
served as the basis of the discussion which, in turn, was designed to 
sensitize them to the, multiple data sources available in an interview other 
than the mere content of the apokefi words, and to monitoring, question- 
asking, and observational/interactional skills involved in this form of data 
elicitation. The FE's were specifically erjoined to attend to their postural 
and paralinguistic, indicators of interest, to the quality of the informant's 
answer given the information desired, - the development of interview agendas, 
the use of probes, "devil's advocate" questions, "hypothetical"; quest ions, 
"idea/typical" questions, artd the like. 



After this exercise, the two FE's were asked to develop an 
interview agenda (on a topic devisedj>y the trainers) with which they would 
practice interviews with each other for 10-minute periods. Their inter- 
views with each other were monitored by the trainers and, when completed, 
the FE's were given feedback on their "performance." The FE f s own written 
experiences about the interview experience when it was over served as the 
basis for enusing discussion. 

The final aspect of the interview , training was to ask each FE to 
develop, another agenda on a topic related to their mini-project which they 
would use the following day at the Oakland Head Start site. Informant 
selectior issues were also discussed. A follow-up discussion was held to 
further address the issues of interviewing, based now on this experience • 

10. Mnemonic and Shorthand Devices 

* a? ; ■ ' : 

Observing and recording complex, rapidly occurring behavioral 
events is often an overwhelming task. Though the issiie of focusing or fram- 
ing tfne's observations had been addressed earlier ift the training, knowledge 
of more specific techniques is required. As a result, a videotape of a 
complex event was played and the FE's were asked to produce raw field notes. 

In the following discussion, an attempt was made to systematize 
some of the procedures vhich hcd already been developed and to introduce 
additional ones. These included the use of diagrams or maps, single word 
glosses for complex behaviors which could be developed more fully later, the 
use of wide margins and non-sequentially entered data, question marks where 
somp de*2il of a fact is in doubt, the use of parenthetical expressions, etc. 

The "last three days of the observational training were primarily 
concerned with addressing the issues related to data reduction and analysis. 

1 1 . Data Reduction and Analysis 

Lecture material fodused on the organization and use of qualitative^ 
data to answer research questions. General topics in this lecture material 
included the issues of what constitutes "proof" in social science research, 
how pattern generalizations are constructed from, qualitative materials, the 
place of "insight" in the data analytic process, and methods of data 
aggregation, such as descriptive accounts, typologies, patterns, and matrix 
formulations. Examples of data aggregation were distributed. In addition, 
the FE's were, asked to use their o\~n field notes for summary descriptive 
purposes, i.e., to describe a "typical" day at the local Head Start site, to 
illustrate^ particular concept identified there/ and so forth. 

The final project for the FE's was to complete the data reduction, 
analysis, and wrfte-Up for their mini-study . The trainers served as 
"consultants" for them in the process. Both FE's read their analysis and _ 
discussion time Vas used to critique these and provide additional information 
related to qualitative'dat* analysis. There was a group discussion on how 
to develop a creditable argument, documentation of facts, assessing the 
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variability inherent in certain data types, presentation of evidence, and 
the like. 



Entry into Field 

Trained participant-observers began focused ethnographic obser- 
vations in October, 1980, at two CFMH program sites (Indiana, Pennsylvania, 
and Georgetown, Texas). Previously in September, the directors of these 
two programs and the mental health worker at the Georgetown site came to 
,the UIHS offices in San Francisco to meet with the CFMH Evaluation Director, 
the SE, and one of the FE's (the other one had not been hired at the time) 
to dfscuss the purposes and goals of the ethnographic component. During 
the first week of October, the SE and the two FE f s made initial site visits 
to introduce the latter to their assigned Head Start programs, program 
directors, CFMH and other staff. In addition to providing an opportunity 
to conduct preliminary observations and meetings with program personnel, 
these visits allowed the FE's to arrange housing and other matters related 
to relocation to the local community. 

These initial contacts with Head Start at*d CFMH Project personnel 
were designed to meet four primary objectives; 

o Gain entry and establish rapport; \ 

o Develop a working relationship and an appropriate 
role for the FE on sitfe; 

o Begin documenting aspects of the CFMH program, 
site, history, participants, setting and any 
relevant variables affecting impact; and 

o Begin interviews with teacher*, aides, administrators, 
and CFMH personnel by way of gauging the knowledge 
base relevant to mental wellness and primary prevention. 

4 During the first four weeks ofc data collection, the ethnographers 

completed all relevant interviews. This interview data performs three 
important functions in the overall evaluation of the CFMH Project. First, 
it represents s/'bsseline" against which additional interview material 
collected at the end of the school' year can be compared. Obviously, an 
important aspect of the impact of such a program would bfc an increased 
knowledge of and better attitudes toward primary prevention and mental 
wellness by program participants. Content analysis will allow the Urban 
Institute to document any significant changes. 

Second r the interview material will be used to assess the degree 
of overlap in knowledge and attitudes held by program participants. At 
issue is how much individual variance may be found in this regard and 
whether Head Start children are being subjected to contradictory demands 
from* the adul 3 on site. 
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Third, the Urban Institute used the information gleaned from these 
* interviews to construct an inventory of behaviors by which adults in the 
CFMH Project recognize mental wellness or social adjustment (or their 
absences) in children, and an inventor' of classroom behaviors by which 
staff further mental wellness or social adjustment. These inventories were 
then merged with the results of actual classroom observations undertaken 
by the FE's as well as behaviors identified in the literature to be related 
to mental Wellness, to construct a formal observational agenda. This agenda 
was completed in December (Appendices A and B) . 

The observational agenda guides the observation of both child and 
teacher behaviors related to mental wellness and social adjustment. Half- 
day samples of behavior two times a year (December and May) were planned, 
allowing comparison of performances over the course of the school year. 
sample of 20 children at each site was selected for these focused observations 
undertaken by the FE's. In addition, interim "tracking" observations of 
half this sample were added to provide a developmental perspective to the 
observations. 

Process data are also being collected by the FE's throughout the 
8-month data collection period. Interviews with staff and community persons, 
classroom observations, informal discussions, unobtrusive measures (e.g., 
newspaper articles or CFMH program brochures), and attendance at all 
counseling/orientation/training sessions will all be used to describe the 
CFMH Project, its history, and socio-situational correlates of its operation. 
Traditional ethnographic field notes will be kept with their strict distinctio 
between observed event and "subjective" interpretation. The fieldworkers 
have been trained to recognize, document, and gauge the consequences of 
reactivity. Their observations while in the field will be guided by an 
index which serves as both a sensitizing instrument of aspects of behavior 
to look for and as one basis for the data storage and retrieval system. 



Summary of Field Experiences 

The ethnographers' field experiences have been highly successful 
to date. Three main factors account for this success. First, a careful 
selection process led to the hiring of two ethnographers with the requisite 
personal qualities and professional experiences which guaranteed the place- 
ment of extremely competent personnel in the two selected programs. 
Secondly, an intensive training experience, derived from one of the most 
innovative and effective university programs to train applied ethnographers, 
prepared the researchers with valuable knowledge and skills for successful 
implementation of • their ethnographies. Finally, the Urban Institute was 
able to identify two Head Start programs that not only were interested in 
participating in the ethnographic project, but that provided program 
characteristics and indications of implementation activities that would 
yield rich, in-depth d^ta for the CFMH evaluation. Initial meetings With 
these programs' administrators as well as continuing, close contact with 
these projects have enhanced the progress of the field ethnographies. 

The initial phase of the field ethnography focused on observations 
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and inquiry geared for familiarization with the two Head Start programs. 
Furthermore, these were intended to outline the scope and elements of the 
experimental CFMH Project in the two programs in a general way. Collection 
of interview material on site-specific attitudes, beliefs and activities 
related to mental health, primary prevention, and CFMH program implementation 
was a specific task during this period. 

During the first two weeks of December, focused observations of 
20 children were carried out-.at- each of the two sites. These observations 
focused upon aspects of mental wellness and social adjustment as observed 
in the classroom behavior of individual children. Appendix A outlines the , 
process- and-content of these observations. 

The ethnographers were brought in to the Urban Institute's offices 
in San Francisco in mid-December. At this time they shared their field 
experiences with the entire CFMH Evaluation staff, reporting on CFMH 
organization and implementation activities in the Georgetown and Indiana 
programs. Emerging trends and patterns were discussed in a hypotheses- 
generating context intended both to focus the remaining ethnographic work 
and to guide the descriptive and interpretive tasks of the overall evaluation. 

This period also permitted the Ethnographic Component starf, 
together with the expert consultant, to review and evaluate the progress of 
the ethnographers. Implementation issues such as role management problems, 
data collection strategies, observational foci, use of the data storage and 
retrieval system, logistical issues, etc., were dealt with. Improvements 
based on initial fieldwork experiences were made on the Child Observation 
Agenda (Appendix A) and a Teacher Observation Agenda (Appendix B) was 
developed. Plans for conducting these and other observations of CFMH 
implementation activities were made, and special attention was given toward 
the development of new observational foci for the ethnographers 1 return into 
the field. 

The ethnographers returned in early January to their assigned 
programs. Since then, new foci of investigation have been initiated at the 
ethnographic sites. In Georgetown, Texas, the ethnographer has begun col- 
lecting systematic information on Mrs. Rosetta Rose, mental health worker, 
as d case example of a key implementor in the CFMH Mental Health Worker 
program model. He will document aspects of Mrs. Rose's personal and 
professional experience, and the relationship of these to CFMH implementation 
in the Georgetown program. Among these areas are personal background, 
experience in Head Start or other early childhood education programs, 
development of interest in mental health, specialized training and profession- 
al supervision, orientation toward primary prevention and child development, 
CFMH responsibilities, etc. 

The other ethnographer is compiling information on the relationship 
between the Indiana, Pennsylvania, CFMH program and the local mental health 
services agency. Again, the emphasis is on a "case study" approach which, 
in this instance, is the CFMH Community Mental Health Resources model linkage. 
Elements of this to be explored include iniciation of the CFMH Community 
Resource linkage, including processes of negotiation and compromise, 
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implementation and maintenance of contracted agreements, budget con- 
siderations, administrative issues, personnel training and skills, logistical 
issues, and program/agency-specific characteristics, etc. 

The field ethnographers are each continuing to make "tracking" 
observations of ten selected children. These are in addition to "snapshot" 
observations of 20 children in each program (out of which the sub-sample of 
tends derived). One observation was completed in December, 1980, and the 
other scheduled for spring, 1981 ♦ 

Ethnographic data collection* of course, continues in all areas 
of CFMH implementation, through observation of classroom and CFMH-specif ic 
activities (e.g., training and other meetings), as wey. as interviews with 
key CFMH personnel. 

The ethnographers'* final return to UIHS was during the week of 
March 16, 1981. At this time, final revisions of the child observation plan 
were made, new observational foci wfere discussed, and the progress of the 
ethnographic component was reviewed. Briefings were held with'the entire 
CFMH staff with an emphasis on specific ethnographic findings and inter- 
pretations in the context of the overall CFMH evaluation. The ethnographers 
shared some of their experiences with the staff and trainees involved in 
the CFMH Site Monitor training which took place during the same week. 

v / The ethnographers. are now in the final phases of the ethnographic 

fi^ldwofk and arrangement?* for their return to UIHS in June are being made. 

v 

V 



29 

ERIC 32 



REFERENCES 



Caplan, G. , Principles of Preventive Psychiatry , Nev York: Basic Books, 
1964, 

Levine, H.G., Gallimore, R. , Weisner, T.S., and Turner, J.L. , "Teaching 
Participation-Observation Research Methods: A Skills Building 
Approach/ 1 Anthropology and Education Quarterly , XI (1), 38-54. 

Office of Child Development: OCD-HS, Head Start Performance Standards . 

Washington, D.C. : Department of Health, Education and Welfare 
and Office of Child Development, 1975. 



30 

33 



APPENDIX A * 

♦ 

CHILD OBSERVATION AGENDA 

CHILD FOCUS SENSITIZING 
AGENDA FOR OBSERVING BEHAVIORS 
RELATED TO MENTAL WELLNESS AND 
SOCIAL ADAPTATION " - "LONGITUDINAL" STUDY 



I. OBSERVATIONS - CONTENT 

A. Gross Behavioral "Complexes" to observe: 

1. Expression of tee lings 

- Own 

- Child talks about his/her feelings * 

« Child shows feelings - e.g., becomes angry, cries, laughs, 
seems Withdrawn". v 

- Sensitivity to others 

2. Disruptive/corapetitive/segregating/rule disobeying be- 
havior vs. helping/sharing/ joining/rule following behaviors. 

3. Autonomy/ self -sufficiency/integrity vs. dependency. 

B. All of the above may be conditioned by one or more of the following: 

L. Type of expression r overt vs. subdued. 

2. Classroom or cultural or interactional "appropriateness • 

3. Cultural/classroom/local definitions of any of the above 
r categories 

4. Prior incidents or understandings or experiences the child may 
have had. 

II. OBSERVATIONS - PROCESS 

A. 10 children selected from 2 centers who are among the 20 randomly 
selected sample for the "snapshot" observations. Each child will 
receive 1 1/2 days of observation over 3 one-half day periods 
carried out within a one week period. All 10 children will be 
observed for 1 1/2 days in January, February and, again for 1 1/2 
days in March, April. 

B. Observations are to be open-ended and fully "contextual", that is, 
incorporating all aspects of setting and history. Children 

(2 at a time) are to be monitored with an emphasis placed upon 
"critical", or otherwise important incidents. 

III. THE GOALS OF THESE OBSERVATIONS ARE: 

A. To serve as a validity check on the "snapshot" observations 
taken during T; (Dec, 1980! and TZ (May, 1981). 

B. To document, at the child level, aspects of classroom management 
related to promoting mental wellness and crisis intervention. 



34 



To' document the consistency of the mental health-related 
behaviors of specific children and differences/similarities 
accross children. 



To learn more of how mental wellness/maladjustment may be seen 
in the classroom through observational research. To define the 
concepts themselves. 

To ascertain any changes in mental health related behaviors 
of children over a 4 1/2 month period. 

To supply the UIHS vith information relevant to the degree to 
which locally defined goals for promoting mental wellness in 
children through classroom techniques are actually implemented 
at the local Head Start centers,. 



•0 



35 



APPENDIX 1 

TEACHER OBSERVATION AGENDA 8 

TEACHER FOCUS SENSITIZING 
AGENDA FOR OBSERVING BEHAVIORS 
RELATED TO PROMOTING MENTAL WELLNESS /PRIMARY 
PREVENTION AND SOCIAL ADAPTATION 
"LONGITUDINAL" STUDY 



I. OBSERVATIONS - CONTENT 

A. flanaral - Karan and Ton 

zx 1. Halpa child axpraaa faalinga - toward solf or others. 

t 

2. Approach toward diaruptiva compatitiva/aegragating/rule 
diaobaying bahaviora. 

3. Approach toward helping/sharing/Joining/rule following 
behaviors . 

4. Helps encourage autonomy/self -sufficiency /integrity. 

5. Promotes dependency in children. 

6. Inconsistencies ^n behavior (over time or among children). 

7. Specific attitudes toward individual children. 

8. Use of and relation to professional and paraprof esslonal 
mental health services and personnel. 

B. Specific - Tom 

1. Helps children who are perceived as unable to handle "all 
the choices" or who are otherwise "shy". 

2. Helps children manage their desires by controlling or changing 

the environment. 

3. Shows respect for children and their inaividuality t e.j^by 
using their names. 

4. Recognises situations over which they have no or only minimal 
control (e.g., in the child's family) which might be 
problematic for the children and monitoring them. 

5. Llatana to child' a apaach (or lack of) for indicatora of 
potential problaaa. 

6. Oriantation to tha I.A.D. ( copy to ba furniahed). 

C. Spacific - Karan 

1. Enforcaa "no hit" policy. 

2. Uaaa "tiaa out" chain whan, with whoa and why. 
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3. Does not stigmatise the child or his/her family in public. 

4. Constraint child's behavior which is "too active" or other-, 
vise dangerous. (What does teacher see as "dangerous 11 ?) 

5. Encourage "positive" fantasy. - 

6. Discourages "negltive fantasy (e.g., "playing with guns"). 

7. Focuses on chil<^ who is setting a good example. 

* 8. Puts stars on classroom chart to regard good behavior during 
structured time. 

9. Consults with Guidance Center staff for specific advice on 
individual children or about classroom behavior management 
techniques. 

10. Encourages social interaction. 

11. Anticipates guidance needs for individual children. 

12. Encouiagss social competency. 

13. Uses positive models of role-playing. 

14. Helps children adjust to demands. 

15. Expresses affection. 

16. Encourages problem-solving behavior. 

17. Attends to peer relations among the children. 

18. Uses "sharing" day and other techniques to touch on child's 
interests and to rllate therfe to classroom goals. 

19. Use of suportivs non-verbal signs. 

D. All of the above may be conditioned by one or more of the following: 

1. Type of expression J overt vs. subdued. 

2. Cultural or teacher definitions of any of the above. 

3. Prior imcidattta or experiences the teacher may have had, 
either In general or with the particular child. 

OBSERVATIONS - PROCESS 

A. Two teachers selected from two centers who have charge over 
at least some of the 10 children selected for study in the 
child- focus! Longitudinal study. Each teacher will receive 
2 days of observation in ont-half day periods spread over 2 
weeks. This will Be repeated 4 times, once in January, once in 
February, 'March and April. 

1. Observations ere to be open-ended amd fully "contextual", 



that is, incorporating all aspects of setting and history. 
Emphasis may be placed upon "critical!* , or otherwise important 
incidents* 

III. THE GOALS OP THE OBSERVATIONS ARE: 

A. To document, at the teacher level, aspects of classroom manage- 
ment related te promoting mental wellness and primary prevention. 

B. To assess the degree of primary vs. secondary and tertiary class- 
rooni intervention. 

C. To document the consistency of a teacher's mental health 
approach (as well as the degree to which this is a conscious 
intervention) as well as to assess this over time ang among 
children. 

D. To learn more of how mental wellness /primary prevention may be 
seen and documented in the classroom through observational 
research. To define the concepts themselves. 

E. To ascertain any changes in mental health-related behaviors - 
of teachers over a A 1/2 month period. 

F. To supply the UIHS with documentation relevant to the degree 
to which teacher defined goals for promoting mental wellness/ 
primary prevention in children through classroom techniques 
are actually implemented in classrooms. 
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APPIMDIX 0 

FILES p ag « Cod« 



FILE 1: 
INTERVIEW INFORMATION ON 
MENTAL HEALTH AND SOCIAL ADJUSTMENT 



v 



(A) ATTITUDES, BELIEFS, AND KNOWLEDGE ABOUT MENTAL HEALTH 



NO. OF ENTRY NAME POSITION DATE INTERVIEWED DATE WRITTEN UP 



Page Code 



FILE I: 
INTERVIEW INFORMATION ON 
MENTAL HEALTH AND SOCIAL ADJUSTMENT 

(B) ATTITUDES, BELIEFS, AND KNOWLEDGE ABOUT PRIMARY PREVENTION 



NO. OF ENTRY 



NAME 



POSITION 



DATE INTERVIEWED 
I 



DATE WRITTEN UP 
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Page Code 



FILE 1: 
INTERVIEW INFORMATION ON 
MENTAL HEALTH AND SOCIAL- ADJUSTMENT 

(C) SPECIFIC CLASSROOM TECHNIQUES FOR ACHIEVING MENTAL HEALTH AND 

PRIMARY PREVENTION AND BEHAVIORS OF CHILDREN BY WHICH MENTAL HEALTH 
AND PRIMARY PREVENTION CAN BE RECOGNIZED. 



NO. OF ENTRY NAME POSITION DATE INTERVIEWED . DATE WRITTEN UP 



Page Cq4e 



FILE 2: 

INFORMATION ON THE IMPLEMENTATION OF 
MENTAL HEALTH AND SOCIAL ADJUSTMENT 



NO. OF ENTRY CLASSROOM «j CENTER DATE OBSERVED DATE WRITTEN UP 



(CONTEXT: ADULTS PRESENT; NAMES OF CHILDREN PRESENT; CLASSROOM PERIOD(S); 
GENERAL BACKGROUND ACTIVITY) . 



/ 
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Page Code 



FILE 3: 

INTERVIEW DATA NOT CONTAINED IN FILE 1 



ENTRY .NO. NAME POSITION PLACE WHERE INTERVIEWED LENGTH OF INTERVIEW 
DATE OF LNTERV £W DATE "OF WRITE-UP BACKGROUND INFORMATION (OPTIONAL) 



(Filed alphabetically by last name of Interviewee and chronologically within 
W ntarviawee) . so 



Page Code 



FILE A: 
CFMH SESSION TYPE 



(A) TRAINING 



ENTRY NO. (NAME OF PARTICIPANTSxAND POSITIONS; PLACE: DATE OF OBSERVATION; 
DATE OF WRITE-UP). \ 



\ 



\ 



\ 

- \ 
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FILE 4: 
CFMH SESSION TYPE 



(B) ORIENTATION 



ENTRY NO. (NAME OF PARTICIPANTS AND POSITIONS; PLACE; DATE OF OBSERVATION; 
DATE OF WRITE-UP) . 
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FILE 4: 
CFMH SESSION TYPE 



(C) COUNSELLING 



- ENTRY NO. (NAME OF PARTICIPANTS AND POSITIONS; PLACE; DATE OF OBSERVATION; 
DATE OF WRITE-UP). 
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CFMH SESSION TYPE 



(D) CONSULTATION 



ENTRY NO. . (NAME OF PARTICIPANTS AND POSITIONS; PLACE; DATE OF OBSERVATION; 
* DATE OF WRITE-UP) . *" 



Page Code 



FILE 4: 
CFMH SESSION TYPE 



(E) SITE SPECIFIC EVENTS 



ENTRY NO. (NAME- OF PARTICIPANTS AND POSITIONS; PLACE; DATE OF OBSERVATION; 

DATE OF WRITE-UP). 



\ Page 

\ • • 

\ FILE 5: 

GENERAL FIELD NOTES ON 
DESCRIPTIVE ASPECTS OF PROGRAM 



DATE OF OBSERVATION DATE OF WRITE-UP SOURCE 



62 



Page Code 



File 6: 
FOCUSED OBSERVATIONS 

CHILD NAME/ CENTER/TIME OF OBSERVATION/ 
DATE OF OBSERVATION/DATE OF WRITE-UP 
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* APPENDIX E 
KEY TO INDEX NUMERICAL CODE 
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KEY TO 
INDEX NUMERICAL CODE 



Variables potentially affecting CFMH Program implementation, 
impact, effectiveness, generalizability, and/or evaluation. 

- This is meant to be an "exploratory" index item in 
which the focused ethnographers enumerate and investi- 
gate internal and external dimensions of the CFMH 
project which might impact upon either the Implementa- 
tion or outcome of the model* Dimensions which become 
more fully identified and re., ned will be given a 
specific numerical code and entered below* 

History 

- Of the Head Start site, of the CFMH program (including 
history of application process, funding, staffing, 
turnover/attrition, comnunity outreach, etc.) 

Setting Descriptions 

1.2.1 Totjp/Ncighborhood 

- Includes description of population (size, racial/ethnic 
composition, language use patterns, SES>, physical 
environment, house types and condition, etc. 

1.2.2 Head Start Site/Centers 

- Includes location in neighborhood, description of 
facilities, busing program, 3tudent population (size, 
racial/ethnic compositions language use patterns, SES), 
size of staff, number ^t--<flassrooms, floor plan, etc. 

/ 

1.2.3. Classro^-" 

- Materials and resources (human and non-human) available, 
student population (size, raciai/ethnic composition, 
language use patterns, SES), floor plan, schedule of 
activity periods, division of responsibilities, etc* 

Cast Of Characters 

- Any statements or observations relevant to the site or 
center participants as a group (especially regarding their 
dedication, competence, background, "type", etc) 

1.3.1 Administrators 

- Any statements or observations relevant "to site, center, 
and/or CFMH administrative personnel as a group (especially 
regarding their dedication, competence, background, "t/pe", 
etc.) 
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1.3. 1.1. Individual Administrators 



- Any information or observation on individual site, center, 
or CFMH administrative staff (includes physical description, 
personal histories, interaction style, competence, dedication 
attitudes to knowledge of mental health and primary preven- 
tion etc.). Use a separate fourth digit in the code for each 
ad minis tra cor. 

1.3.2. Teachers 

- Any statements or observations relevant to the local teaching 
staff as a group (including information on teaching skill, 
interaction style, relations with administration, dedication, 
etc.). 

1.3.2.1. Individual Teachers 

- Any statements or observations relevant to individual teachers 
at the centers (includes physical description, personal 
histories, teaching and interaction style, competence, dedica- 
tion, attitudes to knowledge of mental health and primary 
prevention, etc). Use a separate fourth digit in the code 
for each teacher. 

1.3.3. Other Staff 

- Any statements or observations relevant to the local support 
staff — e.g; classroom aides and volunteers, maintenance 
staff , as a group (including information on their dedica- 
ation, competence, teaching duties and skills, background, 
"type," etc.) Does not include any mental health staff 

' (see below under 1.3.5). 

1.3.3.1 Individual Staff Members 

- Any statements or observations relevant to individual staff 
members at the centers (includes physical description, per- 
sonal histories, teaching styles, duties, competence, dedi- 
cation, attitudes to /knowledge of mental health and primary 
prevention, etc.). Use a separate fourth digit in the code 
for each staff member. 

1.3.4. Parents 

Any statements or observations relevant to parents of the CFMH 
project children as a group (including their orientation to 
and cooperation with the CFMH program, home life, general attitudes 
and parenting skills, backgrounds, etc). 
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1.3.4.1 Individual Parents 



Any statements or observations relevant to individual parents 
of CFMH children (includes physical description, personal 
Histories; attitudes to/knowledge of mental health and primary 
prevention, home life, parenting skills, etc.) Use a separate 
fourth digit in the code for each parent. If a parent serves 
in the school or center as an administrator, teacher, or other 
staff position give them a "parent" code but cross-reference 
to the appropriate "non-parent" code where data on them is to 
be filed. 

1.3.5 Mental Health Personnel 

- Any statements or observations relevant to the mental health 
professionals or paraprof essionals as a group (including 
competence, training, background, dedication, etc.). 

1.3.5.1 Individual Mental Health Personnel 

- Any statements or observations . individual mental health 
professionals or paraprofessio *ls connected with the local 
CFMH project whether on site or out (including physical 
description, interaction style, training, background, duties 
competence* attitudes to knowledge of mental health and 
primary prevention, etc.) Use a separate fourth digit in 
the code for each mental health worker. 

1.3.6. Children 

Any statements or observations relevant to CFMH project 
children (including background, "teachability", "mental 
health", home life, etc.). 

1.3.6. ! Individual Children 
-Any statements or observations relevant to individual 
children in the CFMH project (including physical description, 
background, home life, learning skills, social and pmotional 
adjustment, inappropriate behaviors, teachers, evaluations, 
etc.) Use a separate fourth digit in the code for each 
child. 

Administration 

- Including such aspects of the administrative structure as size 
lines of authority, roles, titles and duties of personnel, 
distinction between the formal and informal structure, paper- 
work and record-keeping functions, etc. 

Coramunity/Headstart - V FMH Relations and Connections 

- Information on the impact of external events, activities, 
agencies, individuals to the implementation and/or outcomes 
of the CFMH project at the local centers. This category 
also includes 'Hashing ton" add the Urban Institute (and local 
participants perceptions of these) and their effects on 
implementation and outcomes. ^ 
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1.6 Classroom Schedule and Activity Periods 

- Includes record of any v ost ed or otherwise formalized 
daily/seasonal schedule and observed variations from 
\ same, examples of activity periods with descriptions 

\ of participants and actual content of periods, aspects 

of class life that might further or impede efforts of 
primary prevention, etc* 

el Type 




.1 



- Any general observations or statements on aspects/ 
value/intent/success/effectiveness/etc, of Model A and 
or B, descriptions of the "ideal program as outlined 
by the model and the "real" model as implemented and 
*ny discrepancies noted between the two, use of or re- 
fiurence to "the model guidelines", etc. 



1 # 8 Mental Health\Deliveryt Primary, Second ary. Tertiary 

- Including any observations or information on how there 
deliver^ forms are conceived, distinguished, and/or im- 
plemented: personnel involved in same; references to the 
terms and Context; etc* 
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APPENDIX P 

DATA RELIABILITY CHECK (SAMPLE) 

FILE 2 



K.2.22 



9. Mclntyre Center/ii. 13. 80/11. 13.80 

Teachers presentt Stephanie Schardt-Head Teacher; Gary Davis 
Asst. Teacher, Sandy-Aide-, Cathy Yard-Cook; Pam-mother of 
Jason, and m other of Desiree; Carol Pike^-Caseworker. r 

T,t(d MUttjUyte}* observed * 8-12noon. ^^^U 

jT^w-tC^^ (*C*c{v? £ * arrived at Mclntyre Center expecting to keep ray appoiiftment . /k 

2 with Stephanie. We were going to discuss the CFMH project i 

at 8 o'clock this morning. She did not arrive until almost ^ ( * 
/ * n i ,1 * ' an hour later so I chatted with Gary, Carol and Cathyiover 

coffee and some danish coffee cake I brought for themv^ • 
Gary explained to me how he constructed a newspaper "tree" | r ^J. C* \ 
he made grow by pulling it's top during his lesson yesterday. 
I asked him about lesson coordination between he and Stephanie J *X'2 
He said that Stephanie basically comes up with the lesson pliip*' 1 
| , !fi (I have heard from a caseworker in another center that she runs 

a very tight program and retains strict control over the way 
the program is run, eg. curriculum ), The health lesson plai s f 
Gary said he is responsiblerand Sandy, the aide, does nutrit: c 
He told me that the more detailed graphics he used in yester- 
day^ corn growing lesson (which Gary drew) was - not done d( liber- 
ally more detailed for Lhe older group .Although Stephanie 
decides on the lesson plans Gary said he felt that he still 
has "leeway'Vithin the plan to do what he wants. Iasked himl 
about the fantasy-or pretend play- I observed him use with th>e/ „. 
/# 0 children; (eg. Doctor-pacient fantasy play between children). j ' JT 

I noted that it seemed like the staff uses it to stimulate pliyt^* # 
as well as to introduce concepts as well, (eg. body parts, wnat$Kj\ 
Doctors do, etc). Gary said that he uses it besause it seems 
' to work well with the children. Aftey I explained to him hor 
I observed Stephanie pretend she was opening a package to gel: 
corn seeds. Gary said he also used fantasy in that activity 
his table with the four year olds. His group pretended they 
were corn stalks and discussed what they needed to grow as t iey" A ^ 
stretched their arms out wide and reached toward the sun wJL| 
their bodies. 



tjh 

. Cathy talked to me about the neighborhood and asked me if ~ < ff/»^ 

I**-* I California was very different. She said -/hat she doesn't 

like about the area is that people know ever^>rVs business and \ 
what they don't know they make up. She gave me the example of i /} 4 
her next dcor neighbor .who pjunded on her door last night J, * 
accusing her children of messing up her yard. Cathy said her 
children wereftAt even home that weekend and how angry she was 
at the woman. 



9am The first group of children arrived. Jason camej^n crying / 
• with his mother who was carrying a toddler. He had not I 
been able to sit by his mother in the Head Start van,aw*remai/ri-' 
ed upset for about a half hour. Gary was collecting the children 
in a small circle and Sandy started to take role kneeling on 
the rug. Jason remained standing in the cluster of ten sitting Q 
i s) chi Idren-s till crying. Gary stood up and took him by the handy, 

''^ to the "time out" chair saying, "Ithink you need to spend some' j*t* f 

time sitting by yourself". Jason sat in the chair about eighnt ^1 
minutes. Stephanie arrived she rtly thereafter very 

ER J C ^ K l \gfc% t &jMM JffiWttiM! « r *«i ent t0 meet earlierStft 

~™ . ' . Te*flcer-P«ent room Cor about 15 minutes, < see interview w/ Stephani 
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SJULL-WItDOC AH) 



CLASS rOWAT 
AMD COHTOff 



gEADIKC 



p.m. 



Introduction 

Prograa 

lacka ro u ad 



Prograa 



Salf-refle*- 

vity 




nasi 

dnvalosai nt 
of tfce CM yrtjict and 
its •valuation; biatory 
end characteristics of 
local M program to. 
be etudind by 

FaudliarisAtion with 
Boat t tart history, 
goals, ««i pellclee 

MtttUlnt of om'i 
••If a* the tool of , 
rasnarch . 



Staff introduction*; 
Dr. Wn. ttayct Lccturs/ 
discuss loo oo the 

o.i.a.s., th« cm 

project, and local 
Head Start Ceatere - 
Dr. Hsyes and Staff 

Lcctura/dlacueelon on 
Hoad Start - Dr. Hayas 
and staff 

Lecture and ssslywnt 
of on-going diary 
axarclaa 



U.X.H.S. 
asterlala * 



Mallnovekl. 3, 
A Diary la th< 
trya senss of 
too word. 



a.a. 



Introduction to 

fsrtlclpaat~ 

Obeervation 



lecoalog an observer: 
introduction to tha 
■ajar skill* in sad 
issues of doing field- 



Dr. Vclsner, lactura/ 
discussion on parti- 
cipant observation; 
"sudden shock* axarclaa. 
lanarelon into a fiald 
aatting with write-up 
and in-class discussion 



p.a. 



Introduction to 

Participant- 

Obaervetlcef 



a 



sacoaia* sa obaarvar: 
int rod u c tion to tha 
aajor skills in and 
isaaas of doing fiald worm 



Diacuaalon coatinuaa 
f roa aornlng sasalon 
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Appendix C- continued 



TRAINING 
PAY § 



TIME or 
DAY 



DOMAIN OF 
INSTRUCTION 



SMU,- BUILDING AMD 
CONCEPTUAL COALS 



CLASS FORMAT 
AND CONTENT 



READIKC 



Observing 
Recording 



p.m. 



Role Management 



a.m. 



Observing 



p.m. 



Hole Meneg. 

Ethics 

Observing 



Observing 
Recording 



Observational strategies 
and notetaklng atyles; 
Issues in note-taking 
such as level of inference 
and rules of evidence 



Sensitization to 
everyday probleaa of 
^^isldwork 



Relating program questions 
to observational goals to 
observational strategies; 
focusing; experiencing con- 
tinuous real-time observation 
and write-up 

learning skills and rationale 
for "first impressions;" self- 
presentation and role definition; 
confronting ethical Issues of 
participant-observer research 



Defining observational 
goala and etrategles; 
Strategies for writing 
up observation; 



Dr. Welsner, in-class 
observational exercises 
and write-up work fol- 
lowing discussion. 
Assignment of observational 
task for day 4 a.m.; idea 
generating exercise 

Dr. Weisner, lecture: 
vhst "really" happens to 
most field-workers, how to 
cope, typical approaches 
to field studies; relation- 
ship of field ethnographers 
to e, .nographlc supervision 

Pre-arranged visit to 
local Head Start Center 



In class discussion of site 
entry and role negotiation 
issues; discussion of ethlcsl 
concerns and presentstlon of 
ethical review procedures; 
reading of field notes and 
discussion of ob.arvatlonal 
and recording strategies 

Lecture o.< observational 
methods. In-class dis- 
cussion bssed on a.m. 
experiences and write-up 
of field notea; defining 
a resesrchable question. 



Colde, P., ■ 
Women In the 
Field 



Appell, C.N., 
Ethical 
Dilemmas In 
An t h ropologlca 1 
Inquiry 
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Appendix G~continued 



TtAINING 
BAT § 



TIME OP 
PAY 



DOMAIN OP 
INSTRUCTION 



SKIIL-BUILDINC AND 
CONCEPTUAL COALS 



CLASS FORMAT 
AND CONTENT 



READING 



Recording 



p.m. 



Interviewing 



a.m. Interviewing 



p. a. 



Interviewing 



Observing 
Recording 



Formatting end indexing 
fieldnotes 



Different types of 
interview strategies; 
planning end executing 
e focueel interview 



Conducting a focused 
Interview 



Conducting e focused 
interview 



Mnemonic end 
shorthand skills in 
taking rough notes 



Dr. Levine, lecture on 
formatting and indexing; 
development of formatting, 
indexing, and quality 
control procedures to be 
used for CMt evaluation 

Dr. Levine, lecture on different 
types of interviewing and 
strengths end limitations of 
each; in-class exercise: observa- 
tlon and discussion of video- 
taped interviews focusing 
on interviewing skills; in class 
exercise: perticlpants plan 
and carry out focused interviews 
of eech other 

Interview of site 
participant at local 
Head Stert Center end 
write-up 

* 

Discussion of morning 
exercise; review of 
the training program 
to date 

In-class: videotape of 
of a classroom shown 
with instructions to 
record behavior and 
setting details; cless dis- 
cussion of exercise focusing 
on techniques used to record 
multi-dimensional, complex, 
rapidly-occuring. behavior 



Spradly 

J. P. 

The 

Ethno- 

Craphlc 

Interview 



:RLC 
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Apptndlx G- continued 



TRAININC TIME OF DOMAIN OF 
WjS i DAY INSTRUCTION 



SKILL- BUILD TrIG AND 
CONCEPTUAL COALS 



CLASS FORMAT 
AND CONTENT 



READING 



p.m. 



All 



Background 



a.m. All 



p.m. All 



a.m. Data Reduction 



p.m. 



10 



Data Reduction 
and Analysis 



Data Reduction 
and Analysis 



Using formatting 
procedure 

Mental Health 
reaearch and theory » 
primary prevention, 
social competence, 
and child psychology. 

Using formatting , 
procedure 



Organizing and using 
qualitative da:a to 
answer research questions 



Indexing and coding 



Organizing and using 
qualitative data to 
answer questions 



Pre-arranged visit to 
local Head Start Center 

Dr. T. Hilliard/Dr. Hayes 
lecture/discussion 



Pre-arranged visit to 

local Head Stare Center 

- final data collection day 

J. Maclaa review and 
debriefing 

Dr. Levlne; lecture 
"proof 1 * in social science 
research; using qualitative 
materials for illustration 
to develop typologies, to 
construct patterns and 
generalization; "paths to 
insight" 

Develop indexing system for 
CFMH ethnography; code own 
fieldnotes; discussion of 
these processes and their 
problems 

Dr. Levin lecture, demon- 
stration and discussion 



Examples of 
naturalistic 
research 
handed out In 
class 
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Appendix G- continued 
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TT Mr AV 

t int ur 


DOMAIN OF 


SKILL-BUILDING AND 


CLASS FORMAT 




hay I 

VAT * 


riAV 


INSTRUCTION 


CONCEPTUAL GOALS 


AND CONTENT 


READING 


10 


p.n. 


Data Reduction 


Organizing and using 


Apply techniques using 








and Analysis 


qualitative data to 


own project work toward 










answer research questions 


finished product 




11 


a.m. 


Data Reduction 


Organizing and using 


Participants use class time 








and Analysis 


qualitative data to 


to write up reports on their 










answer research questions 


own observations over post 












two weeks: report Includes site 












description, a "typical" day in 












the classroon focus of study, 












observations undert , and 












tentative conclusion: Staff are 












available to consult and advise. 






p*a. 


Data Reduction 


As above 


Participants present their 








and Analysis 




reports and all staff 












comment and critique 








Training Course 


Use of evaluation 


In-class discussion 








Evaluation and 


to help determine 


based on diary material; 








Self-Evaluation 


later training and 


close and good-byes 










to encourage self- 












reflection by the 








• 


• 


field ethnographers 


# 
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